Language translation with head-worn computing

ABSTRACT

Aspects of the present invention relate to language translation systems for head-worn computers.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.17/083,228, filed Oct. 28, 2020, which is a continuation of U.S.application Ser. No. 16/149,405, filed Oct. 2, 2018 (now U.S. Pat. No.10,853,589 issued Dec. 1, 2020), which is a continuation of U.S.application Ser. No. 15/494,827, filed Apr. 24, 2017 (now U.S. Pat. No.10,146,772 issued Dec. 4, 2018), which is a continuation of U.S.application Ser. No. 14/659,815, filed Mar. 17, 2015 (now U.S. Pat. No.9,672,210 issued Jun. 6, 2017), which is a continuation-in-part of thefollowing U.S. Patent Applications:

U.S. application Ser. No. 14/490,586 filed Sep. 18, 2014 (now U.S. Pat.No. 9,423,842 issued Aug. 23, 2016); U.S. application Ser. No.14/307,465 filed Jun. 17, 2014 (now U.S. Pat. No. 9,651,787 issued May16, 2017); U.S. application Ser. No. 14/323,123 filed Jul. 3, 2014 (nowabandoned); Ser. No. 14/262,615 filed Apr. 25, 2014 (now U.S. Pat. No.9,158,116 issued Oct. 13, 2015).

All of the above-identified applications and patents are herebyincorporated by reference in their entirety.

BACKGROUND Field of the Invention

This invention relates to head worn computing. More particularly, thisinvention relates to language translation systems for head-worncomputers.

Description of Related Art

Wearable computing systems have been developed and are beginning to becommercialized. Many problems persist in the wearable computing fieldthat need to be resolved to make them meet the demands of the market.

SUMMARY

Aspects of the present invention relate to language translation systemsfor head-worn computers.

These and other systems, methods, objects, features, and advantages ofthe present invention will be apparent to those skilled in the art fromthe following detailed description of the preferred embodiment and thedrawings. All documents mentioned herein are hereby incorporated intheir entirety by reference.

BRIEF DESCRIPTION OF THE DRAWINGS

Embodiments are described with reference to the following Figures. Thesame numbers may be used throughout to reference like features andcomponents that are shown in the Figures:

FIG. 1 illustrates a head worn computing system in accordance with theprinciples of the present invention.

FIG. 2 illustrates a head worn computing system with optical system inaccordance with the principles of the present invention.

FIG. 3A, FIG. 3B, and FIG. 3C illustrate three views of a head worncomputer in accordance with the principles of the present invention.

FIG. 4 illustrates a temple and ear horn in accordance with theprinciples of the present invention.

FIG. 5A, FIG. 5B, FIG. 5C, FIG. 5D, FIG. 5E and FIG. 5F illustrate atemple and ear horn assembly in various states in accordance with theprinciples of the present invention.

FIG. 6 illustrates an adjustable nose bridge assembly in accordance withthe principles of the present invention.

FIG. 7 illustrates an adjustable nose bridge assembly in accordance withthe principles of the present invention.

FIG. 8 illustrates speaker assemblies for head-worn computers inaccordance with the principles of the present invention.

FIG. 9 illustrates a stiff ear horn with a touch pad for a head-worncomputer in accordance with the principles of the present invention.

FIG. 10 illustrates a top plate in accordance with the principles of thepresent invention.

FIG. 11 illustrates temperature test results of an embodiment of thepresent invention.

While the invention has been described in connection with certainpreferred embodiments, other embodiments would be understood by one ofordinary skill in the art and are encompassed herein.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT(S)

Aspects of the present invention relate to head-worn computing (“HWC”)systems. HWC involves, in some instances, a system that mimics theappearance of head-worn glasses or sunglasses. The glasses may be afully developed computing platform, such as including computer displayspresented in each of the lenses of the glasses to the eyes of the user.In embodiments, the lenses and displays may be configured to allow aperson wearing the glasses to see the environment through the lenseswhile also seeing, simultaneously, digital imagery, which forms anoverlaid image that is perceived by the person as a digitally augmentedimage of the environment, or augmented reality (“AR”).

HWC involves more than just placing a computing system on a person'shead. The system may need to be designed as a lightweight, compact andfully functional computer display, such as wherein the computer displayincludes a high resolution digital display that provides a high level ofemersion comprised of the displayed digital content and the see-throughview of the environmental surroundings. User interfaces and controlsystems suited to the HWC device may be required that are unlike thoseused for a more conventional computer such as a laptop. For the HWC andassociated systems to be most effective, the glasses may be equippedwith sensors to determine environmental conditions, geographic location,relative positioning to other points of interest, objects identified byimaging and movement by the user or other users in a connected group,and the like. The HWC may then change the mode of operation to match theconditions, location, positioning, movements, and the like, in a methodgenerally referred to as a contextually aware HWC. The glasses also mayneed to be connected, wirelessly or otherwise, to other systems eitherlocally or through a network. Controlling the glasses may be achievedthrough the use of an external device, automatically throughcontextually gathered information, through user gestures captured by theglasses sensors, and the like. Each technique may be further refineddepending on the software application being used in the glasses. Theglasses may further be used to control or coordinate with externaldevices that are associated with the glasses.

Referring to FIG. 1 , an overview of the HWC system 100 is presented. Asshown, the HWC system 100 comprises a HWC 102, which in this instance isconfigured as glasses to be worn on the head with sensors such that theHWC 102 is aware of the objects and conditions in the environment 114.In this instance, the HWC 102 also receives and interprets controlinputs such as gestures and movements 116 of body parts of a user. TheHWC 102 may communicate with external user interfaces 104. The externaluser interfaces 104 may provide a physical user interface to takecontrol instructions from a user of the HWC 102 and the external userinterfaces 104 and the HWC 102 may communicate bi-directionally toaffect the user's command and provide feedback to the external device108. The HWC 102 may also communicate bi-directionally with externallycontrolled or coordinated local devices 108. For example, an externaluser interface 104 may be used in connection with the HWC 102 to controlan externally controlled or coordinated local device 108. The externallycontrolled or coordinated local device 108 may provide feedback to theHWC 102 and a customized GUI may be presented in the HWC 102 based onthe type of device or specifically identified device 108. The HWC 102may also interact with remote devices and information sources 112through a network connection 110. Again, the external user interface 104may be used in connection with the HWC 102 to control or otherwiseinteract with any of the remote devices 108 and information sources 112in a similar way as when the external user interfaces 104 are used tocontrol or otherwise interact with the externally controlled orcoordinated local devices 108. Similarly, HWC 102 may interpret gestures116 (e.g captured from forward, downward, upward, rearward facingsensors such as camera(s), range finders, IR sensors, etc.) orenvironmental conditions sensed in the environment 114 to control eitherlocal or remote devices 108 or 112.

We will now describe each of the main elements depicted on FIG. 1 inmore detail; however, these descriptions are intended to provide generalguidance and should not be construed as limiting. Additional descriptionof each element may also be further described herein.

The HWC 102 is a computing platform intended to be worn on a person'shead. The HWC 102 may take many different forms to fit many differentfunctional requirements. In some situations, the HWC 102 will bedesigned in the form of conventional glasses. The glasses may or may nothave active computer graphics displays. In situations where the HWC 102has integrated computer displays the displays may be configured assee-through displays such that the digital imagery can be overlaid withrespect to the user's view of the environment 114. There are a number ofsee-through optical designs that may be used, including ones that have areflective display (e.g. LCoS, DLP), emissive displays (e.g. OLED, LED),hologram, TIR waveguides, and the like. In embodiments, lighting systemsused in connection with the display optics may be solid state lightingsystems, such as LED, OLED, quantum dot, quantum dot LED, etc. Inaddition, the optical configuration may be monocular or binocular. Itmay also include vision corrective optical components. In embodiments,the optics may be packaged as contact lenses. In other embodiments, theHWC 102 may be in the form of a helmet with a see-through shield,sunglasses, safety glasses, goggles, a mask, fire helmet withsee-through shield, police helmet with see through shield, militaryhelmet with see-through shield, utility form customized to a certainwork task (e.g. inventory control, logistics, repair, maintenance,etc.), and the like.

The HWC 102 may also have a number of integrated computing facilities,such as an integrated processor, integrated power management,communication structures (e.g. cell net, WiFi, Bluetooth, local areaconnections, mesh connections, remote connections (e.g. client server,etc.)), and the like. The HWC 102 may also have a number of positionalawareness sensors, such as GPS, electronic compass, altimeter, tiltsensor, IMU, and the like. It may also have other sensors such as acamera, rangefinder, hyper-spectral camera, Geiger counter, microphone,spectral illumination detector, temperature sensor, chemical sensor,biologic sensor, moisture sensor, ultrasonic sensor, and the like.

The HWC 102 may also have integrated control technologies. Theintegrated control technologies may be contextual based control, passivecontrol, active control, user control, and the like. For example, theHWC 102 may have an integrated sensor (e.g. camera) that captures userhand or body gestures 116 such that the integrated processing system caninterpret the gestures and generate control commands for the HWC 102. Inanother example, the HWC 102 may have sensors that detect movement (e.g.a nod, head shake, and the like) including accelerometers, gyros andother inertial measurements, where the integrated processor mayinterpret the movement and generate a control command in response. TheHWC 102 may also automatically control itself based on measured orperceived environmental conditions. For example, if it is bright in theenvironment the HWC 102 may increase the brightness or contrast of thedisplayed image. In embodiments, the integrated control technologies maybe mounted on the HWC 102 such that a user can interact with itdirectly. For example, the HWC 102 may have a button(s), touchcapacitive interface, and the like.

As described herein, the HWC 102 may be in communication with externaluser interfaces 104. The external user interfaces may come in manydifferent forms. For example, a cell phone screen may be adapted to takeuser input for control of an aspect of the HWC 102. The external userinterface may be a dedicated UI, such as a keyboard, touch surface,button(s), joy stick, and the like. In embodiments, the externalcontroller may be integrated into another device such as a ring, watch,bike, car, and the like. In each case, the external user interface 104may include sensors (e.g. IMU, accelerometers, compass, altimeter, andthe like) to provide additional input for controlling the HWD 104.

As described herein, the HWC 102 may control or coordinate with otherlocal devices 108. The external devices 108 may be an audio device,visual device, vehicle, cell phone, computer, and the like. Forinstance, the local external device 108 may be another HWC 102, whereinformation may then be exchanged between the separate HWCs 108.

Similar to the way the HWC 102 may control or coordinate with localdevices 106, the HWC 102 may control or coordinate with remote devices112, such as the HWC 102 communicating with the remote devices 112through a network 110. Again, the form of the remote device 112 may havemany forms. Included in these forms is another HWC 102. For example,each HWC 102 may communicate its GPS position such that all the HWCs 102know where all of HWC 102 are located.

FIG. 2 illustrates a HWC 102 with an optical system that includes anupper optical module 202 and a lower optical module 204. While the upperand lower optical modules 202 and 204 will generally be described asseparate modules, it should be understood that this is illustrative onlyand the present invention includes other physical configurations, suchas that when the two modules are combined into a single module or wherethe elements making up the two modules are configured into more than twomodules. In embodiments, the upper module 202 includes a computercontrolled display (e.g. LCoS, DLP, OLED, etc.) and image light deliveryoptics. In embodiments, the lower module includes eye delivery opticsthat are configured to receive the upper module's image light anddeliver the image light to the eye of a wearer of the HWC. In FIG. 2 ,it should be noted that while the upper and lower optical modules 202and 204 are illustrated in one side of the HWC such that image light canbe delivered to one eye of the wearer, that it is envisioned by thepresent invention that embodiments will contain two image light deliverysystems, one for each eye. It should also be noted that while manyembodiments refer to the optical modules as “upper” and “lower” itshould be understood that this convention is being used to make iteasier for the reader and that the modules are not necessarily locatedin an upper-lower relationship. For example, the image generation modulemay be located above the eye delivery optics, below the eye deliveryoptics, on a side of the eye delivery optics, or otherwise positioned tosatisfy the needs of the situation and/or the HWC 102 mechanical andoptical requirements.

An aspect of the present invention relates to the mechanical andelectrical construction of a side arm of a head worn computer. Ingeneral, when a head worn computer takes the form of glasses,sun-glasses, certain goggles, or other such forms, two side arms areincluded for mounting and securing the had worn computer on the ears ofa person wearing the head worn computer. In embodiments, the side armsmay also contain electronics, batteries, wires, antennas, computerprocessors, computer boards, etc. In embodiments, the side arm mayinclude two or more sub assemblies. For example, as will be discussed inmore detail below, the side arm may include a temple section and an earhorn section. The two sections may, for example, be mechanicallyarranged to allow an ear horn section to move such that both side armscan fold into a closed position.

FIG. 3A, FIG. 3B and FIG. 3C illustrate three separate views of a headworn computer 102 according to the principles of the present invention.Turning to the head worn computer illustrated as FIG. 3A, one side armof the HWC 102 is folded into its closed position. The ear horn section308 of the side arm is rotated relative to its temple section 304 tocreate space relative to the other side arm 310 so when the other sidearm is moved into its closed position it can fully close. In a situationwhere the ear horn did not rotate to create the space (not illustrated)the ear horn would physically interfere with the other side arm 310,when the side arm was in the closed position, and prevent the other sidearm 310 from fully closing. The HWC FIG. 3B view illustrates the HWCFIG. 3B with both side arms folded into a fully closed position. Notethat the ear horn 308 is in the rotated position with respect to itstemple section 304 such that the other arm 310 closed withoutinterfering with the ear horn 308. The HWC FIG. 3C view also illustratesboth arms in closed positions with the ear horn 308 rotated to createthe space for the other arm 310 to fully close. FIG. 3C also illustratesa portion of the HWC 102 where electronics may be housed in a top mount312. The top mount may contain electronics, sensors, optics, processors,memory, radios, antennas, etc.

FIG. 4 illustrates a side arm configuration in accordance with theprinciples of the present invention. In this embodiment, the side armincludes two sub assemblies: the temple section 304 and the ear horn308. FIG. 4 illustrates two views of the side arm assembly, one from anouter perspective and one from a sectioned perspective. The ear hornincludes a pin 402 that is designed to fit into a hole 404 and to besecured by connector 408. The connector 408 is rotatable and in oneposition locks the pin 402 in place and in another position unsecuresthe pin 402 such that the ear horn 308 can be removed and re-attached tothe temple section 304. This allows the detachment and re-attachment ofthe ear horn 308 from the temple section 304. This also allows for thesale of different ear horns 308 for replacement, of which a variety ofcolors and patterns may be offered. In embodiments, the temple section304 may include a battery compartment 410 and other electronics, wires,sensors, processors, etc.

FIG. 5A, FIG. 5B, FIG. 5C, FIG. 5D, FIG. 5E and FIG. 5F illustrateseveral views of a HWC side arm with temple 304 and ear horn 308sections. The views include outer perspectives and cross sections aswell as various states of the security of the ear horn 308 with thetemple section 304. One embodiment of an outer perspective andcross-section of a temple assembly and earhorn assembly is shown in FIG.5A and FIG. 5B, respectively, including connector and pin assembly 510A,wherein the ear horn is in its final secured position and ready to beput on the head of a user FIG. 5C and FIG. 5D illustrate the ear horn308 and the temple section 304 in a secure, but separated and un-rotatedposition. The same pin 402 and connector 408 system described inconnection with FIG. 4 is illustrated in the cross sections of FIG. 5Eand FIG. 5F at connector and pin assembly 512. In the secured un-rotatedposition the pin is pulled internally within the temple section firmlysuch that it stays in place. FIG. 5C and FIG. 5D illustrate a statewhere the ear horn 308 is separated from the temple section 304. Thisstate is achieved when pressure is used to pull on the ear horn 308. Inembodiments, the pressure is exerted by a user pulling on the ear horn308, which compresses a spring in the connector and pin assembly 510Bthat is mechanically associated with the pin 402 in the ear horn 308.The mechanism uses the spring to maintain pressure on the pin 402 tomaintain connection with the connector 408 when the connector 408 is ina position to lock the pin 402 in position. FIG. 5E and FIG. 5Fillustrates a state where, after the ear horn 308 has been pulled intothe state described in connection with FIG. 5C and FIG. 5D, the ear horn308 is rotated about the pin 402. This puts the ear horn 308 in arotated position as described herein such that the first arm, with thisrotated ear horn 308, does not interfere with the closure of the otherarm 310 when the two arms are folded into the closed position. FIG. 5Eand FIG. 5F illustrates the connector and pin assembly as continuing tosecure the ear horn 308 to the temple 304 in the rotated position.

An aspect of the present invention relates to an adjustable nose bridge.An adjustable nose bridge may be important with head worn computers,especially those with computer displays, to ensure comfort and alignmentof the displays and/or other portions of the head worn computer. FIG. 6illustrates a HWC 102 with an adjustable nose bridge 602. The nosebridge is adjustable through a mechanism in the HWC 102. In embodiments,the mechanism includes a fixed notched attachment 604, a movable pin 608adapted to fit into the notches of the notched attachment 604, and aselection device 610 that is attached to the movable pin 608. Themovable pin 608 and nose bridge 602 are connected such that the as themovable pin 608 shifts in position the nose bridge 602 moves in positionas well. The selection device 610 causes the movable pin 608 to engageand disengage with the fixed notched attachment 604 when presses andallowed to retract. As illustrated in FIG. 6 , the selection device 610is not in a pressed position so the movable pin 608 is engaged with thenotched attachment 604 such that the nose bridge is securely attached ina stable position. FIG. 7 illustrates a scenario where the selectiondevice is pressed, or activated, such that the moveable pin 608 is nolonger engaged with the fixed notched attachment 604. This allows thenose bridge 602 to move up and down with respect to the rest of the HWC102. Once the movable pin 608 aligns with a notch of the notchedattachment 604, the two parts may engage to re-secure the nose bridge inthe HWC 102.

In embodiments, a side arm of the HWC 102 may include an audio jack (notshown) and the audio jack may be magnetically attachable to the sidearm. For example, the temple section 304 or ear horn section 308 mayhave a magnetically attachable audio jack with audio signal wiresassociated with an audio system in the HWC 102. The magnetic attachmentmay include one or more magnets on one end (e.g. on the head phone endor the side arm end) and magnetically conductive material on the otherend. In other embodiments, both ends of the attachment may have magnets,of opposite polarization, to create a stronger magnetic bond for theheadphone). In embodiments, the audio signal wires or magneticconnection may include a sensor circuit to detect when the headphone isdetached from the HWC 102. This may be useful in situations where thewearer is wearing the headphones during a period when there is notconstant audio processing (e.g. listening for people to talk withperiods of silence). In embodiments, the other side's headphone may playa tone, sound, signal, etc. in the event a headphone is detached. Inembodiments, an indication of the detachment may be displayed in thecomputer display.

In embodiments, the HWC 102 may have a vibration system that vibrates toalert the wearer of certain sensed conditions. In embodiments, thevibration system (e.g. an actuator that moves quickly to cause vibrationin the HWC 102) may be mounted in a side arm (e.g. the temple section304, or ear horn 308), in the top mount 312, etc. In embodiments, thevibration system may be capable of causing different vibration modesthat may be indicative of different conditions. For example, thevibration system may include a multi-mode vibration system,piezo-electric vibration system, variable motor, etc., that can beregulated through computer input and a processor in the HWC 102 may sendcontrol signals to the vibration system to generate an appropriatevibration mode. In embodiments, the HWC 102 may be associated with otherdevices (e.g. through Bluetooth, WiFi, etc.) and the vibratory controlsignals may be associated with sensors associated with the other device.For example, the HWC 102 may be connected to a car through Bluetoothsuch that sensor(s) in the car can cause activation of a vibration modefor the vibration system. The car, for example, may determine that arisk of accident is present (e.g. risk of the driver falling asleep, cargoing out of its lane, a car in front of the wearer is stopped orslowing, radar in the car indicates a risk, etc.) and the car's systemmay then send a command, via the Bluetooth connection, to the HWC 102 tocause a vibratory tone to be initiated in the HWC102.

Another aspect of the present invention relates to a removable andreplaceable speaker assembly for a HWC 102. There are times whendifferent speaker types are desired or when a speaker may malfunction.It is therefore desirable to have a speaker assembly that is removableand replaceable by the user. To facilitate the removal and reattachmentof the speaker assembly a magnetic or magnetic attachment system may beincluded. For example, the speaker assembly and head-worn computer mayinclude magnetic elements such that the speaker can be removed byexerting pressure and replaced by getting the two sections close to oneanother. In another example, the speaker or head-worn computer may havea button, slider, etc. that can be interacted with to remove thespeaker. In embodiments, the speaker assembly may have a form factor ofan ear bud, ear phone, head phone, head set, external ear speaker, etc.In embodiments, the speaker assembly may include a vibratory system toprovide haptic feedback to the user. In embodiments, such a removableand replaceable speaker system may be provided to both of the user'sears.

FIG. 8 illustrates several embodiments where HWC 102's are associatedwith speaker systems. Earbud 802 may be removably attached to the HWC102 with a magnetic system or mechanical system or combination thereof.Speaker 804 may also be removably attached to the HWC102 in a similarway. The speaker 804 may be positioned to emit sound towards the user'sear but not actually be positioned in the ear. This configuration mayprovide for greater environmental hearing for the user as the ear wouldnot be blocked by an ear bud, head phone, etc. The speaker 804 maygenerate audio waves and/or ultrasonic waves that are converted intoaudio when they are emitted through the air. When ultrasonic transducersare used, more than one frequency transducer may be included. Seehttp://en.m.wikipedia.org/wiki/Sound from ultrasound andhttp://www.holosonics.com for references on generating sound fromultrasound. The speaker and/or piezo vibratory system 808 is depicted asintegrated into the temple. In embodiments, this module may beintegrated such that it can be removed and replaced and it may also beadapted such that it does not hang below the temple piece. Each of theremovable and replaceable speaker systems described herein may include avibratory system (e.g. piezo electric circuit that is controlled by theHWC 102.

In embodiments, a head-worn computer may include a temple portionmechanically secured to a computer display and adapted to position thecomputer display in front of an eye of a user, and the temple portionincluding a speaker attachment, wherein the speaker attachment isadapted to securely position a speaker assembly and electricallyassociate the speaker assembly with electronics internal to thehead-worn computer and facilitate the user's release and re-securing ofthe speaker assembly with the temple portion. The speaker attachment mayinclude a magnetic element, moveable mechanical element, etc. orcombination thereof to secure and unsecure the speaker system from theHWC 102. The speaker assembly may have a form factor adapted to beinserted into an outer ear of the user, cover at least a portion of anouter ear of the user, cover substantially all of an outer ear of theuser, to position the speaker under the temple assembly and above an earof the user, to position a speaker under the temple assembly and infront of an ear of the user, angle the speaker towards the ear, etc. Thespeaker system may further have a vibratory system to provide hapticfeedback to the user. The haptic feedback may be coordinated with a gamebeing presented in the computer display, an application running on theHWC 102, etc. In embodiments, a vibratory system is provided in bothspeaker systems to provide controllable haptic feedback in stereo and/oron both or either side of the user's head.

In embodiments, the connection between the speaker system and the HWC102 may be positioned other than under the temple section. It may bepositioned on a side, top, bottom, end of a section of the side arm, forexample. It may be positioned on the front bridge, for example. Inembodiments, the speaker system may be connected to a top or sideportion and the speaker may be further positioned to face forward, awayfrom the user's ear. This may be a useful configuration for providingsound to others. For example, such a configuration may be used when theuser wants to provide translations to a person nearby. The user mayspeak in a language, have the language translated, and then spokenthrough the forward facing speakers.

The removable nature of the speaker systems may be desirable forbreakaway situations so a snag does not tear the glasses from the useror pull hard on the user's ear. The removable nature may also be usefulfor modularity configurations where the user wants to interchangespeaker types or attach other accessories. For example, the user maywant ear buds at one point and an open ear speaker configuration atanother point and the user may be able to make the swap with ease giventhis configuration. The port on the HWC 102 may also be adapted forother accessories that include lights or sensors for example. Theaccessory may have an ambient light sensor to assist with the control ofthe lighting and contrast systems used in the HWC 102 displays, forexample. In embodiments, the speaker port may be used as a charging portfor the HWC 102 or data port for the HWC 102.

An aspect of the present invention relates to a language translationsystem with a head-worn computer. In embodiments, the head-worn computerincludes a microphone and an audio communication system. The microphoneis associated with a processor and is used to record a spoken utteranceof a person wearing the head-worn computer. The microphone is positionedin the head-worn computer such that the person wearing the head-worncomputer can speak in a normal tone and volume and the microphone willrecord the user's utterances. The head-worn system is further adapted toconvert the spoken utterance into a language other than a first spokenlanguage represented by the spoken utterance, forming translatedlanguage. For example, if the user is speaking in English, the recordedEnglish spoken words will be recognized and converted into a secondlanguage (e.g. Spanish). The converted language can then be played in anaudio system such that the converted language is played through anassociated speaker system.

The speaker in the language translation system may be wired orwirelessly connected to the head-worn computer. The speaker also will beof sufficient size and power to produce sound intensity such that aperson at a conversational distance can hear the sound at aconversational level. For example, the speaker may produce sound in arange of approximately 30 to 40 db at a distance of 5 feet from thespeaker. This is a relatively quiet conversational sound intensity andmay be used in a quiet sound level environment. The speaker may producesound in a range of approximately 40 to 60 db at a distance of 5 feetfrom the speaker. This is a moderate sound level and may be used in amoderate sound level environment. The speaker may produce sound in arange of approximately 60 to 80 db at a distance from 5 feet of thespeaker. This is a relatively loud sound level and may be used in a loudenvironment. The speaker may be powerful enough for a maximum level(e.g. 80 db) and the audio system may be controllable to a lower level(e.g. 30 db). In embodiments, the sound level from the speaker may beautomatically regulated depending on the sound in the environment. Inembodiments, the sound level may be manually regulated. A manuallyregulated system may be regulated through gesture control, an externaluser interface adapted to regulate aspects of the head-worn computer, acontrol mounted on the head-worn computer, etc. The manually regulatedsystem may be regulated by a control on the speaker itself.

In embodiments, the speaker is adapted to be positioned separately fromthe head-worn computer at a spot where it can be secured mechanicallybut to cause the sound to emanate from a direction similar to thedirection of the user's speech. For example, the speaker may bemechanically adapted to fit into a shirt pocket of the user. This atleast partially conceals the speaker and secures it such that the soundcomes from a similar direction as the user's speech. The speaker may bemechanically adapted to clip onto a shirt of the user or otherwiseadapted to be properly positioned.

The head-worn computer may be further adapted to communicate thetranslated language to the speaker and display, in a see-throughhead-worn display mechanically supported by the head-worn computer, avisual representation of the first or second language. For example, thevisual representation may be a representation of the original languageconverted based on the utterances such that the person wearing thehead-worn computer can see, as a confirmation, the language that was theoutput of the conversion process. This can help to avoidmiscommunications. In the event that the conversion process improperlyconverted the spoken language, the user would be able to correct thesystem because the visual representations would give him the indicationof improper conversion. As another example, the visual display mayrepresent the converted language. This may help the person wearing thehead-worn computer learn the second language. It may also be useful in asituation where the user is trying to speak the second language and justwants help from the head-worn system from time to time. For example, theuser may have the language conversion system off, and then turn it onwhen he finds himself lacking an understanding of how to say somethingin the second language. Once on, the conversion system can assist him byspeaking the converted language to the other person and/or displayingthe words or other representations in the see-through display.

In embodiments, the user may be able to turn the visual representationof the first or second language off. This user control may be helpful ina number of situations. For example, the user may want to rely on theconversion system and not want the additional distraction of the visualrepresentations of the language presented in his field of view. This maybe the case when the user needs to provide greater attention to theother person, situation or environment. The user control may becontrolled by a gesture, external user interface, head-worn computermounted user interface, etc. The user interface may also provide avisual representation of the user interface and/or the state of the userinterface in the see-through display.

Another aspect of the language conversion system in the head-worncomputer relates to the control of the audible tone of the secondlanguage produced through the speaker system. There may be situationswhere the use of a custom or predetermined audible tone may be useful.For example, if the audible tone from the speaker approximates theaudible tone of the user himself than the system may produce a morepersonal situation between the user and the listener. For example, thetranslated language may have an audible spectrum based on the user'sspoken utterances. The audible spectrum may be determined through ananalysis of the spoken utterance's spectrum. The analysis may result inone of a plurality of pre-determined tones to be used when communicatingthe translated language to the speaker. For example, selected tone maybe a high male tone, mid-tone male, low male tone, high female tone,mid-tone female, low female tone, etc. In embodiments, the user maymanually select the tone.

In embodiments, the audible tone of the spoken utterances is analyzedand categorized by a signature, wherein the signature defines powerwithin spectral ranges. The signature can then be used to modify thetone of the speaker system. For example, the signature may indicate thata high frequency range in the person's voice is not powerful so aspectral filter with a suppression of the range may be applied to thetone produced by the speaker system. A technique generally referred toas voice morphing may be used to approximate the user's voice. See thefollowing published paper for additional information on voice morphing:Eng. Dept., Cambridge Univ., UK, DOI: 10.1109/ICASSP.2004.1325909Conference: Acoustics, Speech, and Signal Processing, 2004. Proceedings.(ICASSP '04). IEEE International Conference on, Volume: 1.

Another aspect of the present invention relates to securing thehead-worn computer 102 to the user's head in a way that the computerdoes not slip down the nose of the user, due to the extra front weightof the HWC 102, but does not create discomfort for the user. While somehave designed systems that use lateral force between the two side armsto squeeze the HWC arms on the sides of the user's head, this solutiontends to cause comfort problems. The squeeze on the user's head has tobe relatively high, as compared to non-computer glasses, to maintainenough pressure to overcome the additional weight in the front of theglasses and this high pressure tends to cause comfort issues. Inembodiments of the present invention, a substantially stiff ear horn isprovided and the back end of the ear horn wraps around the user's headand touches the user's head. The touch point is towards the back of theuser's head such that it provides a point or area of counteracting forcefor the HWC 102 if it tries to pull forward or down the user's nose dueto the front weight of the HWC 102. In embodiments, the end of the earhorn, or a section near the end, has a touch pad. The touch pad may bemade of soft material so it is comfortable on the back of the user'shead. In embodiments, the touch pad may be mounted such that it hasangular flexibility. The angular flexibility allows the touch pad tobetter align with the touch point on the user's head so it can providethe counteractive force but spread the force over an area for greatercomfort.

In embodiments, a head-worn computer is provided and has a see-throughcomputer display configured to be mounted on the head of a user; a sidearm configured to secure the see-through computer display to the user'shead, the side arm further configured to be positioned to lay againstthe user's head proximate an ear of the user; and the side arm includinga stiff member extending behind the ear of the user, contoured tosubstantially follow a curvature of the user's head behind the ear ofthe user, and to touch a portion of the user's head towards the rear ofthe user's head such that the see-through computer display remainssubstantially secure in a position in front of an eye of the user.

In embodiments, the stiff member is removeably secured to a templeportion of the side arm (as described herein elsewhere). The stiffmember may be telescopically adjustable to fit the user's head. Thestiff member may be provided with a ratchet style securing mechanism foradjusting the telescopic adjustment. The stiff member may be providedwith a rotatable style securing mechanism for adjusting the telescopicadjustment, or another style securing mechanism may be provided. Thestiff member may touch a portion of the user's head at a rear end of thestiff member. The rear end of the stiff member may include a touch pad.The touch pad may be made of a soft material to increase the comfort andsurface area of the touch area. The touch pad may be attached such thatit has angular flexibility such that the touch pad changes position toincrease a touch surface in contact with the rear of the user's head.

FIG. 9 illustrates a HWC 102 mounted on the head of a user. The HWC 102has a see-through optics module 204, a temple portion 304, a stiff earhorn 904 and a head-touch pad 902. As described herein elsewhere, thestiff ear horn 904 may be removable and replaceable. This can be usefulwhen the exchange of ear horns from one type to another or one size toanother is desired, for example. The stiff ear horn 904 may be made ofaluminum, aluminum tubing, carbon fiber, or other material that isrelatively stiff. The stiffness should be of a level that provides forlateral inflexibility such that the touch pad 902 can exertcounteracting force with a high rear facing vector. Too much flexibilityin the stiff ear horn 904 can detract from the rear-facing vector offorce when the weight of the HWC 102 is pulling forward/down the nose.In embodiments, several different lengths, shapes, stiffnesses, etc. ofstiff ear horn 904 may be provided so the user can select the set thatbest serves his purpose. The head-touch pad 902 may be made of a softmaterial, malleable material, etc. to provide comfort to the user and toincrease the head touch surface. The head-touch pad 902 may also bemounted in such a way that the head-touch pad 902 can flex and/or changeangle as it is pressed upon. The head-touch pad 902 may, for example, bemounted on the stiff ear horn 904 with a hinge or pivot mechanism suchthat the head-touch pad 902 self aligns with the user's head when theHWC 102 is put on the user's head. This configuration may increase thetouch surface area between the head-touch pad 902 and the user's headand generate a larger counteracting force to prevent the slipping ormoving of the HWC 102.

In embodiments, the side arms of the HWC 102 are designed to exertinward lateral pressure on the user's head, but the lateral pressure isreduced so it is not uncomfortable, along with having stiff side arms904 and head-touch pads 902. In these embodiments, the ear horns 904 andhead touch pads 902 cause significant counteracting forces in additionto the counteracting forces applied through the inward lateral forcesapplied by the side arms.

Another aspect of the present invention relates to the thermalmanagement of the head-worn computer. In embodiments, the head-worncomputer is a high functioning self-contained computer with wirelessconnectivity where the electronics are compacted to fit into a glassesstyle form factor. In embodiments, the main heat producing electronicsare in an upper portion of a bridge section over the top of the lensesof the head-worn computer (e.g. as described in connection with FIG.3B). The thermal management technologies described herein manage theheat such that the system can operate in high temperature environments(e.g. 55 degrees C. ambient) and maintain a comfortable temperature forthe user (e.g. below 70 degrees C. along the forehead section).

FIG. 3B illustrates an embodiment of a head-worn computer wherein theelectronics are housed in an upper bridge section above the lenses ofthe glasses form factor. This has been referred to as the top mount 312.The top mount 312 may include the majority of the electronics that areused to form the fully functional computer. This may include theprocessor, memory, sensors, cameras, optical drive system, etc. In thisembodiment, the batteries are housed in the temple portions of the sidearms. The top mount 312 may include a cavity where the circuit board(s)are housed and secured. The top mount may also include a top plate 1000designed to be mounted on the top of the cavity such that it forms aportion of the enclosure. In embodiments, the top plate 1000 is designedto receive heat from the circuit board and/or components mounted on thecircuit board and then dissipate the heat into the environmentsurrounding the head-worn computer.

FIG. 10 illustrates several perspective views of an embodiment top plate1000. The top plate outside view 1002 illustrates the heat dissipatingfins on the top of the top plate 1002. The heat dissipating fins are onthe outside of the completed head-worn computer assembly and dissipatethe heat into the surrounding environment. The top plate front view 1004illustrates a front perspective of the top plate. The top plate insideview 1008 illustrates a bottom view of the top plate. The bottom is theportion that is on the inside of the circuit board cavity in the fullyassembled head-worn computer. The bottom of the top plate 1000 may havefeatures to facilitate the mechanical and thermal connection with thecircuit board and/or components on the circuit board. For example, inthe embodiment illustrated in FIG. 10 the top plate 1000 includes aninternal component thermal connection pad 1010. The thermal connectionpad 1010 may be adapted to mechanically and thermally connect with theinternal circuit board and/or a component on the circuit board (e.g. theprocessor, memory, or other heat producing component). The assembly mayhave intervening material between the top plate 1000 and the circuitboard and/or circuit board component (e.g. a heat spreader platedesigned to receive heat from a component or set of components and thenspread the heat over an area, thermally conductive paste, glue, pad, orother facilitating material). In embodiments, a thermally conductivematerial is placed between the circuit board and/or circuit boardcomponent(s) and the thermal connection pad 1010 of the top plate 1000to eliminate any air gap that might otherwise develop as a result of themechanical mismatch of the components in the assembly. This can furtherfacilitate the transfer of heat from the heat producing component(s)(e.g. the processor) to the thermal connection pad 1010 and out to thesurrounding environment through the heat dissipating fins. The inventorsused a thermally conductive material from Fujupoly in the thermallytested devices. This material has an advertised thermal conductivity of11 Watt/m-k. Watt/m-k is a unit of measurement of thermal efficiency forthermal interface material.

FIG. 11 illustrates some test results relating to a head-worn computerwith a top plate 1000 assembly as described herein. The head-worncomputer was placed in an environmental chamber at 55 degrees Celsius.The head-worn computer was then turned on and the top plate 1000temperature was observed. Operation of the processor was also observed.As can be seen, the maximum temperature of the top plate 1000 remainedbelow 70 degrees Celsius. While 70 degrees Celsius is still a fairly hotmaximum temperature, the heat dissipating fins caused the assembly to becomfortable to the human touch. In addition to maintaining an acceptableoutside assembly temperature, the processor continued to operatethroughout the testing, which is a significant advantage over the stateof the art.

Although embodiments of HWC have been described in language specific tofeatures, systems, computer processes and/or methods, the appendedclaims are not necessarily limited to the specific features, systems,computer processes and/or methods described. Rather, the specificfeatures, systems, computer processes and/or and methods are disclosedas non-limited example implementations of HWC.

All documents referenced herein are hereby incorporated by reference.

1. A language translation system, comprising: one or more processors; a wearable head device including a microphone system and a see-through display, the wearable head device in communication with the one or more processors; a speaker in communication with the one or more processors; and wherein the one or more processors are adapted to: receive a spoken utterance of a person wearing the wearable head device, convert the spoken utterance into a language other than a first spoken language represented by the spoken utterance, forming translated language, communicate the translated language to the speaker, and display a visual representation of the spoken utterance in the first spoken language via the see-through display.
 2. The language translation system of claim 1, wherein the one or more processors are adapted to communicate to the speaker via a wired connection.
 3. The language translation system of claim 1, wherein the one or more processors are adapted to wirelessly communicate to the speaker.
 4. The language translation system of claim 1, wherein the speaker produces sound of less than 40 db at a distance of 5 feet from the speaker.
 5. The language translation system of claim 1, wherein the speaker produces sound of less than 60 db at a distance of 5 feet from the speaker.
 6. The language translation system of claim 1, wherein the speaker produces sound of less than 80 db at a distance of 5 feet from the speaker.
 7. The language translation system of claim 1, wherein the translated language has an audible spectrum based on the spoken utterance of the person wearing the wearable head device.
 8. The language translation system of claim 7, wherein the audible spectrum is determined through an analysis of a spoken utterance spectrum, wherein the analysis results in one of a plurality of tones to be used when communicating the translated language to the speaker.
 9. The language translation system of claim 8, wherein the one tone is at least one of a high male tone, a mid-tone male, a low male tone, a high female tone, a mid-tone female, or a low female tone.
 10. The language translation system of claim 1, wherein the speaker is mechanically adapted to fit into a shirt pocket of the person wearing the wearable head device.
 11. The language translation system of claim 1, wherein the speaker is mechanically adapted to clip onto a shirt of the person wearing the wearable head device.
 12. The language translation system of claim 1, wherein the one or more processors are configured to present a user interface that turns off the displaying of the visual representation of the translated language.
 13. The language translation system of claim 1, wherein the one or more processors are configured to present a user interface that displays a visual representation of the spoken utterance in the translated language, and switch between the visual representation of the spoken utterance in the first spoken language and the visual representation of the spoken utterance in the translated language.
 14. The language translation system of claim 1, wherein the one or more processors are configured to: identify a gesture by the person wearing the wearable head device, and in response to identifying the gesture, stop displaying the visual representation of the spoken utterance.
 15. The language translation system of claim 1, wherein the one or more processors are configured to, in response to receiving a signal from an external user interface, stop displaying the visual representation of the spoken utterance. 